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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C § 133). 
• Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 

earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)^ Responsive to communication(s) filed on 01/14/2000 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G, 213. 
Disposition of Claims 

4) H Claim(s) 1-21 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) I3 Claim(s) 1-21 is/are rejected. 

7) S Claim(s) M2 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) 13 The drawing(s) filed on 14 January 2000 is/are: a)E3 accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)DAII bjD Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attach me nt(s) 

1 ) S Notice of References Cited (PTO-892) 4) d Interview Summary (PTO-413) Paper No(s). . 

2) O Notice of Drafts person's Patent Drawing Review (PTO-948) 5) d Notice of Informal Patent Application (PTO-152) 

3) d Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) d Other: 



U.S. Patent and Trademark Office 
PTO-326 (Rev. 04-01) 



Office Action Summary 



Part of Paper No. 2 



Application/Control Number: 09/483,3 1 7 Page 2 

Art Unit: 2176 

DETAILED ACTION 

1. This action is responsive to communications: application filed on Cl/14/00. 

2. Claims 1-21 are pending in the case. Claims 1, 7, 13, and 19 are independent claims. 



Information Disclosure Statement 

3. The listing of references US 5,991,751 and US 5,991,780 in the specification is not a 
proper information disclosure statement. 37 CFR 1 .98(b) requires a list of all patents, 
publications, or other information submitted for consideration by the Office, and MPEP § 609 
A(l) states, "the list may not be incorporated into the specification but must be submitted in a 
separate paper." Therefore, unless the references have been cited by the examiner on form PTO- 
892, they have not been considered. 

Claim Objections 

4. Claims 8, 9, and 10 are objected to because of the following informalities: Each of the 
claims states dependency on claim 1 , however claim one does not have lettered steps as in claims 
8, 9, and 10. Claim 7 which immediately precedes this set of three claims does have lettered 
steps. The examiner assumes this is a typographical error and claims 8, 9, and 10 should actually 
read to be dependent on claim 7 and consequently will treat them as such. Appropriate 
correction is required. 

5. Claims 10, 11, and 12 are objected to because of the following informalities: Claim 10 
adds step e'. Claim 1 1 adds the step e". Claim 12 adds the step e'" and f . The prime 
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indications are not necessary since these three claims are dependent in parallel to claim 7. 
Appropriate correction is required. 

Claim Rejections - 35 USC §103 

6. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1-21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Rivette 
et aL, US 5,991,780 A priority filed 11/19/1993 in view of Krause et al, US 5,625,827 filed 
12/23/1994. 

Regarding independent claim 1 ? Rivette teaches u a document reading means for 
reading a document having textual descriptions and at least a drawing consisted of graphic 
elements each with an associated alpha-numeral designation, wherein said document reading 
means is further provided for converting said document to a plurality of processor-recognized 
elements" in Fig. 9 and 10. Fig. 9 demonstrates how the documents arrive in electronic format 
from the Patent and Trademark Office and then in Fig. 10 displays the process of converting the 
documents into process-recognized elements. 

Rivette also teaches "a search and link means for searching said processor-recognized 
elements and linking each of said graphic elements with at least one associated segment of 
textual description" in col. 3 lines 28-51. Rivette describes how the text and image files are 
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synchronized to produce Equivalent Files. The files are the equivalent of the elements and 
synchronized is the equivalent of linking in the claimed invention. 

Rivette teaches the display of both graphics and associated text including the column and 
line numbers of said text on the screen immediately next to one another in both Fig. 33 and col. 4 
lines 19-24. Fig. 33 shows and col. 4 lines 19-24 explains a patent image window immediately 
next to a window of associated text. What Rivette does not teach is the display of text labels 
immediately next to each graphic element. 

Krause further teaches "a display means for displaying said drawing with each of said 
graphic elements displayed immediately next to said associated segment of textual description" 
in Fig. 5. The graphic elements and the text labels and text descriptions are all readily available 
to the user on one screen. It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Rivette with Krause to create the claimed invention. One 
of ordinary skill in the art could have taken the text of Rivette and used it to replace the 
numbered labels on the images, as is done in Krause, through the use of automatic link 
generation systems and techniques which the applicant discloses were readily available in the 
market. It would have been obvious and desirable to make this modification such that the 
combined image and text information was easier to read. 

Regarding dependent claim 2, which is dependent on claim 1, Rivette and Krause teach 
the limitations of claim 1 as explained above. Rivette discloses a document-location-finder from 
a search in col. 4 lines 24-34 and a column and line coordinates described in col. 16 lines 7-24. 
Rivette also teaches a display means for displaying the text which contains the original column 
and line information described in col. 2 lines 42-50. It would have been obvious to one of 
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ordinary skill in the art at the time the invention was made to modify Rivette such that it displays 
the location information of the text in the same manner as the claimed invention. 

Regarding dependent claim 3, which is dependent on claim 1, Rivette and Krause teach 
the limitations of claim 1 as explained above. Rivette discloses a graphical user interface in col. 
3 lines 49-51 and a text search in col, 4 lines 24-34. Rivette depicts this search in Fig. 46. A 
search will obviously generate a report to display the results to the user after the search has 
completed. 

Regarding dependent claim 4, which is dependent on claim 1, Rivette and Krause teach 
the limitations of claim 1 as explained above. Rivette discloses a user interface in col. 3 lines 49- 
51 and search and link in col. 4 lines 24-34. Rivette teaches the display of a graphic element 
linked with an associated text segment in col. 3 line 66 to col. 4 ljne 3. 

Regarding dependent claim 5, which is dependent on claim 2, Rivette and Krause teach 
the limitations of claim 2 as explained above. Rivette discloses a user interface for searching and 
linking and also displaying the location of a found text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and in col. 4 lines 24-34. 

Regarding dependent claim 6, which is dependent on claim 2, Rivette and Krause teach 
the limitations of claim 2 as explained above. Rivette discloses a user interface for searching and 
linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 through col. 4 line 3, 
and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic element, its 
associated text, linked naming-term and said term's location in col. 2 lines 42-50 and col. 16 
lines 7-24. 
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Regarding independent claim 7, Rivette teaches a document reading means and how to 
convert the documents into processor-recognizable elements in Fig. 9 and 10. Fig. 9 
demonstrates how the documents arrive in electronic format from the Patent and Trademark 
Office and then in Fig. 10 displays the process of converting the documents into process- 
recognized elements. Rivette describes how the text and image files are synchronized to produce 
Equivalent Files in col. 3 lines 28-51. The files are the equivalent of the elements and 
synchronized is the equivalent of linking in the claimed invention. Rivette teaches the display of 
graphic elements with associated textual descriptions in Fig. 33 and in col. 4 lines 19-24. What 
Rivette does not teach is the display of text labels immediately next to each graphic element. 

Krause further teaches "a display means for displaying said drawing with each of said 
graphic elements displayed immediately next to said associated segment of textual description" 
in Fig. 5. The graphic elements and the text labels and text descriptions are all readily available 
to the user on one screen. It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Rivette with Krause to create the claimed invention. One 
of ordinary skill in the art could have taken the text of Rivette and used it to replace the 
numbered labels on the images, as is done in Krause, through the use of automatic link 
generation systems and techniques which the applicant discloses were readily available in the 
market. It would have been obvious and desirable to make this modification such that the 
combined image and text information was easier to read. 

Regarding dependent claim 8, which is dependent on claim 7, Rivette and Krause teach 
the limitations of claim 7 as explained above. Rivette discloses a document-location-finder from 
a search in col. 4 lines 24-34 and a column and line coordinates described in col. 16 lines 7-24. 
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Rivette also teaches a display means for displaying the text which contains the original column 
and line information described in col. 2 lines 42-50 and col. 16 lines 7-24. 

Regarding dependent claim 9, which is dependent on claim 7, Rivette and Krause teach 
the limitations of claim 7 as explained above. Rivette discloses a user interface for searching and 
linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 through col. 4 line 3, 
and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic element, its 
associated text, and a linked naming-term in col. 2 lines 42-50 and col 16 lines 7-24. 

Regarding dependent claim 10, which is dependent on claim 7, Rivette and Krause 
teach the limitations of claim 7 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, and a linked naming-term in col. 2 lines 42-50 and col. 16 lines 7-24. 

Regarding dependent claim 11, which is dependent on claim 7, Rivette and Krause 
teach the limitations of claim 7 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, a linked naming-term, and its location in col. 2 lines 42-50 and col. 
16 lines 7-24. 

Regarding dependent claim 12, which is dependent on claim 7, Rivette and Krause 
teach the limitations of claim 7 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
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element, its associated text, a linked naming-term, and its location in col. 2 lines 42-50 and col. 
16 lines 7-24. 

Regarding independent claim 13, Rivette teaches the display of a graphic element and 
its linked associated text segment in Fig. 33 and col 3 line 66 to col. 4 line 5. What Rivette does 
not teach is the display of text labels immediately next to each graphic element. Krause further 
teaches "a display means for displaying said drawing with each of said graphic elements 
displayed immediately next to said associated segment of textual description" in Fig. 5. The 
graphic elements and the text labels and text descriptions are all readily available to the user on 
one screen. It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify Rivette with Krause to create the claimed invention. One of 
ordinary skill in the art could have taken the text of Rivette and used it to replace the numbered 
labels on the images, as is done in Krause, through the use of automatic link generation systems 
and techniques which the applicant discloses were readily available in the market. It would have 
been obvious and desirable to make this modification such that the combined image and text 
information was easier to read. 

Regarding dependent claim 14, which is dependent on claim 13, Rivette and Krause 
teach the limitations of claim 13 as explained above. Rivette also teaches a display for drawing a 
graphic element, its associated text, linked naming-term, and said term's location in col. 2 lines 
42-50, col. 3 line 66 through col. 4 line 3, and col. 16 lines 7-24. 

Regarding dependent claim 15, which is dependent on claim 13, Rivette and Krause 
teach the limitations of claim 13 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
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through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, and a linked naming-term in col. 2 lines 42-50 and col. 16 lines 7-24. 

Regarding dependent claim 16, which is dependent on claim 13, Rivette and Krause 
teach the limitations of claim 13 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, and linked naming-term in col. 2 lines 42-50 and col. 16 lines 7-24. 

Regarding dependent claim 17, which is dependent on claim 14, Rivette and Krause 
teach the limitations of claim 14 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, linked naming-term and said term's location in col. 2 lines 42-50 and 
col. 16 lines 7-24. 

Regarding dependent claim 18, which is dependent on claim 14, Rivette and Krause 
teach the limitations of claim 14 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col 3 line 66 
through col. 4 line 3, and col. 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, linked naming-term and said term's location in col. 2 lines 42-50 and 
col. 16 lines 7-24. 

Regarding independent claim 19, Rivette teaches a method of displaying a graphic 
element and its linked associated text segment in Fig. 33 and col. 3 line 66 to col. 4 line 5. What 
Rivette does not teach is the display of text labels immediately next to each graphic element. 



# 
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Krause further teaches "a display means for displaying said drawing with each of said graphic 
elements displayed immediately next to said associated segment of textual description" in Fig. 5. 
The graphic elements and the text labels and text descriptions are all readily available to the user 
on one screen. It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify Rivette with Krause to create the claimed invention. One of 
ordinary skill in the art could have taken the text of Rivette and used it to replace the numbered 
labels on the images, as is done in Krause, through the use of automatic link generation systems 
and techniques which the applicant discloses were readily available in the market. It would have 
been obvious and desirable to make this modification such that the combined image and text 
information was easier to read. 

Regarding dependent claim 20, which is dependent on claim 19, Rivette and Krause 
teach the limitations of claim 19 as explained above. Rivette also teaches a display for drawing a 
graphic element, its associated text, and said text's location in col. 2 lines 42-50, col. 3 line 66 
through col. 4 line 3, and col. 16 lines 7-24. 

Regarding dependent claim 21, which is dependent on claim 19, Rivette and Krause 
teach the limitations of claim 19 as explained above. Rivette discloses a user interface for 
searching and linking a naming-term to associated text in col. 3 lines 49-51, col. 3 line 66 
through col. 4 line 3, and col 4 lines 24-34. Rivette also teaches a display for drawing a graphic 
element, its associated text, linked naming-term and said term's location in col. 2 lines 42-50 and 
col. 16 lines 7-24. 



Conclusion 
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The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Schwalb et al. US 6,256,595 Bl filed 03/04/1998 shows on Fig. 7 an image with text 
markers to indicate various entities on the image. Tzou et al., US 5,530,942 filed 02/13/1995 
contains disclosures on a graphical user interface used for displaying graphics and related text 
simultaneously on the computer screen. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Peter J Smith whose telephone number is 703-305-593 1 . The 
examiner can normally be reached on Mondays-Fridays 7:00am-3:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R Herndon can be reached on 703-308-5 1 86. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-746-7239 for regular 
communications and 703-746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3900. 




